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A wide variety of queueing systems with a single server can be mod- 
eled by the equation b n +i = (b n - 1) + + z n , where b n denotes queue 
length and z n the input. The usual assumption about the sequence \z n \ 
is that it be a sequence of independent identically distributed (i. i. d.) 
random variables. However, in many applications, this is not really the 
case; \z n \ is a sequence of correlated random variables. We show that 
with the help of a transformation, a (k + l)-dimensional Markov pro- 
cess that suffices to describe the queueing system may be found, where 
k is the memory of the input process. We derive an equation for the 
steady-state generating function corresponding to the joint distribution 
of this vector process. We find that a simple set of equations can be 
obtained for the marginal distributions. In particular, the steady-state 
distribution of b n , the queue length, can be obtained without solving 
for the joint distribution. 

I. INTRODUCTION 

Several computer systems and networks involve queueing models with 
single server queues. We consider a discrete-time queueing system, with 
service time normalized to unity, modeled by the equation 

b n + l = b n ~ 1 +Z n lfb n > 1 

= z n if b n = 

b n+ l = (bn - D + + Zn (1) 



or equivalently 



Here b n denotes queue length 1 and the nonnegative integer valued se- 
quence z n is the input. 

A vast majority of literature in queueing theory deals with the case 
when \z n \ is a sequence of independent identically distributed random 
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variables. In this situation, when the average value Ez n < 1,6 = lim„t«,* 
b n is a well-defined random variable, and various authors have analyzed 
the distribution of 6; see Ref. 1. 

An interesting approach is due to Spitzer 2 who uses a simple conse- 
quence of eq. (1): when 6 = then 



b n +i = max 



£ z n -i ~ r 
;=o 



(2) 



to derive an integral equation for the distribution of b. However, we will 
follow the approach that models \b n \ as a Markov process as in Ref. 3. 
Here the theory of Markov chains can be used to derive formulas for the 
equilibrium distribution of b n , that is, the distribution of b. 

The literature dealing with models where \z n \ are not necessarily in- 
dependent is relatively scant. Recently Ali Khan 4 and Herbert 6 have 
analyzed the case when z n is the state of a denumerable Markov chain. 
In this case (b n ,z n ) forms a Markov process, thus relaxing somewhat the 
condition that \z n ) are independent identically distributed (i. i. d.) ran- 
dom variables. 

The queueing process that motivated the work presented in this paper 
arose in a data communications system. Messages are temporarily stored 
in a buffer before they are sent across the communications network. It 
is assumed that the buffer transmits one packet, the basic unit of data, 
in a unit time interval, provided that it is not empty. In this context, then, 
z n is the number of packets that arrive at the buffer in the time interval 
(n,n + 1]. It is assumed that the inputs are correlated and z n is taken to 
be a sum of moving averages. 

In order to illustrate the techniques, the particular example z n -x\ 
+ x\-2 + x\ is first analyzed. This corresponds to the arrival of two kinds 
of messages. The first kind of message consists of two packets which are 
spread apart in time, the second packet being transmitted two units of 
time after the first packet. The number of such messages generated in 
the (n + l)st time unit is denoted by x\. The second kind of message 
consists of just one packet, and the number of such messages generated 
in the (n + l)st time unit is denoted by x\. It is assumed that (jcJ,xJ), 
n = 0, 1, 2, . . . , are independent identically distributed vector random 
variables. However, for each n,x\ and x\ may be dependent. In partic- 
ular, if 

£(*i*fe|4)-*[(l-p)ti + pt*] 

with < p < 1 fixed, then the probability that a message is of the first 
kind is 1 — p, and the probability that it is of the second kind is p. 



* We mean here limit in distribution: for each ;, 

\imPr\b n <j\ = Pr\b<j\ 
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There are several other examples where such a model for the input 
process z n is more appropriate than the usual one. We give two examples. 
Consider a queueing system where each request for service may consist 
of a sequence of tasks to be completed by the same server. However, these 
tasks may not be available for completion in the same time interval; in- 
stead they are spread out in time. Hence the random variables corre- 
sponding to the number of tasks arriving at the server may be correlated 
as in the above example. This model may apply to a scheduler in a 
computer processing system. Another example, that of a dam fed by 
rivers that originate at geographically distant points, motivated the 
model considered by Herbert. 6 When rainfall occurs, affecting the flow 
in all of the rivers, the increase in flow to the dam is spread out in time 
since the origins of the rivers are at different distances from the dam. 
A discrete time model of the dam process, similar to the one in the packet 
network example above, can be solved by the method presented in this 
paper. 

In general we assume that 

Zn = L £ «j»i-j (3) 

/"=1;'=0 

where the nonnegative integer valued random variables in the sequence 
\(x l n ,x n , . . . ,x f n )\ are independent and identically distributed, and a) are 
nonnegative integers with a' Q > for each i. For each n the random 
variables x\,x n , . . . ,x c n may be dependent on each other. Notice that z n 
by itself is not necessarily a Markov process. As far as we know there is 
only one work dealing with a special case of eq. (3) which is related to 
ours. Herbert 6 considers the case when 

k 

Zn= T. <*jX n -j (4) 

where \x n ] are i. i. d. random variables and a, are positive integers. In 
this case whenever x n ^ 0, b n+i ^ 0, i ■ 1, . . . , k + 1, hence b n+r is lin- 
early related to b n +i, T m 2, . . . , k + 2 from eq. (1). From this property, 
formulas can be derived for the equilibrium distribution for b n given 
x n -i, x n -2, • • • , x n -k- However, even in this special case our approach 
gives formulas for 

6 = lim b n 

rif- 

itself more simply than the method of Ref. 6. 

In the general case b n is not a Markov process, but it is shown that, 
with the help of a transformation, a (k + 1) -dimensional Markov process 
that suffices to describe the queueing system may be found. The first 
component of this Markov process is just b n . An equation is derived for 
the steady-state generating function corresponding to the joint distri- 
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butions. This equation involves a multinomial, which corresponds to zero 
queue length. It is shown that a finite system of linear equations can be 
obtained to solve for the coefficients in this multinomial. A simple set 
of equations for the marginal distributions is then derived, leading to 
the calculation of the steady-state generating function of the queue 
length. 

In Sec. II we review the case when z n are i. i. d. random variables. An 
example for a system where z n is a moving average is worked out in Sec. 
Ill to illustrate our method. In Sec. IV we introduce the model considered 
in this paper and describe the transformation that leads to the simpli- 
fication in the solution. The generating function of the underlying vector 
Markov process is derived in Sec. V. The method of solving for certain 
parameters that occur in Sec. V is described in Sec. VI. The isolation of 
marginals and the derivation of a simple set of equations for them is the 
subject of Sec. VII. A pair of limiting cases of the input process is ana- 
lyzed in Sec. VIII. Finally, for a special class of problems, some formulas 
relating the limiting cases are also derived in Sec. VIII. The terminology 
of Markov chains used in this paper is consistent with that of Ref. 3. 

II. QUEUE WITH INDEPENDENT INPUTS 

When \z n \ is a sequence of independent identically distributed random 
variables, it follows that b n is a Markov process. The number of packets 
waiting to be transmitted, b n , serves as the state for a Markov chain S. 
The state space of <S is the set of nonnegative integers. The transition 
probabilities for S are generated by eq. (1) as follows: 

P** 1 A Pr {b n+1 - i) - L Pr \b n+1 = i\b n = ;1 P] 

;>0 

= LPrlz n ~i-(j-D + }Pf (5) 

Let Pr \z n = i\ = p, for i = 0,1, .... Then, since z n is a nonnegative in- 
teger, 

P? +1 = PiP n o+ZPi- j+ iPf (6) 

y'=i 

When 1 > po > 0, S is irreducible and aperiodic. The following theorem 
gives conditions under which S is positive recurrent. 

Theorem 1: The Markov-chain S is positive recurrent when Ez n < 1. 

When S is positive recurrent then 

lim b n = b 
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is a well-defined random variable and the equilibrium distribution of 
b n , that is, the distribution of b, is such that 

lim Pr \b n = j\ = *j > for; = 0,1, ... (7) 

Furthermore, if Pf = ttj, j = ,1, . . . , so is P" +1 , and wj are the unique 
nonnegative solution to the infinite system of linear equations: 



£ *>• = 1 
1-0 



and, for i = 0,1, . . . , 



1+1 

*i = P/7T0 + E Pi-j+lKj (8) 

These are obtained from eq. (6) by substituting Pf = P" +1 = 71-;. 

For a proof of the above results see Karlin. 3 

In order to solve for the equilibrium distribution we will employ the 
method of generating functions. For any random variable x , the gener- 
ating function of x, <t> x (s), is defined as 

<j> x (s) = Es*,\s\ <1 (9) 

Let 

ct> n (s) = Es»" = Y.P?sK 
i=0 

Then using eq. (1) and the independence of b n ,z n we have 

E S bn + l = £ S (bn-D + ES Z " (10) 

From the definition of </>„ it follows that 

<t>n.l(s) = (s-^nis) + (1 ~ S-l)P$<t>As) (11) 

where <t> z (s) = Es Zn . Assuming that Ez n < 1 and 1 > p > 0, let the gen- 
erating function of 

b = lim b n 
be 

0(S) = E TTiS 1 
j'=0 

[see eq. (7)]. Then from above it is clear that if 0„(s) = </>(s) then <f) n +i(s) 
= <j)(s). So from eq. (11) we get 

1 -s l 2 («) 
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To find 7T we take expectations of both sides of eq. (1) and take the limit 
as n 1 °°. Then 

tto = 1 - Ez n (13) 

So 

a - s)4> z (s)a - Ez n ) 

<t>(s) = — — (14) 

2 (s) -s 

This gives the generating function of 6 in terms of 2 (s). However, to 
get tj, we need not invert the generating function 0(s). Treating Z , 
as formal power series, using 11/ to denote 2/ =0 7r„ and equating like 
powers of s in eq. (14), we can show: 

n = tto = 1 - Ez n 

III = (ttoPi + n - piIIo)/po 

II, = (tcqPj + Uj-i - £ ftllf-A /p (15) 

Equations (15) give explicitly the formulas needed to solve for itj or 
Uj. Notice that any finite number of the ir/s can be determined by 
solving a finite number of linear equations. Informally we refer to such 
a situation as being finitely solvable. 



III. AN EXAMPLE OF A QUEUING PROCESS WITH CORRELATED 
INPUTS 

In the context of the application discussed in 1, there are instances 
when the data arriving at the buffer form a sequence of correlated ran- 
dom variables. For an example we consider here a case when there are 
two classes of sources that generate data. The first kind generates two 
packets whenever it transmits a message. However, these packets are 
not generated simultaneously; instead they are spread apart in time, the 
second packet being transmitted two seconds after the first one. The 
number of such messages generated in the (n + l)st second is denoted 
by x\. The second class of sources generates messages of one packet each 
and the number of such messages generated in the (n + l)st second is 
denoted by x 2 n . (x^x*), n ■ 0, 1, 2, ... , are assumed to be independent 
identically distributed vector random variables. Note that, for each n, 
x\ and x 2 n may be dependent. Then the number of packets arriving at 
the buffer in the (n + l)st second is 

Z n =X l n + xl- 2 + xl (16) 

So the number of packets in the buffer at the end of the (n + l)st second 
1748 THE BELL SYSTEM TECHNICAL JOURNAL, NOVEMBER 1977 



is given as in eq. (1) by 

b n+1 = (b n - D + + x\ + x n _ 2 + x\ (17) 

It is clear b n is not a Markov process. However, (b n , x\-i, x n - 2 , x n _i, x^_ 2 ) 
is a five-dimensional Markov process. We will derive another Markov 
process from eq. (17) that is only three-dimensional and suffices to de- 
scribe the queueing process. Define 

yOn - b n 
yin = yOn + *n-2 
y2n=yin + X l n - 1 (18) 

Then from eq. (17) we have 

yo.n+i = [(yon - D + - yon] + ym + *\ + X 2 n 
yi,n+i = ICyon - D + - yon] + y2n + x n + x\ 
y 2 ,n+i = [(yon - D + - yon] + ym + 2xi + x\ (19) 

Let von = Win = x n + x\ and v 2n = %x n + x\. Then (li 0r , u in , u 2n ) is 
independent of (yoy» yij, y2j) for ; < n by assumptions about x\, x n . 
Hence (yo n , yin, y2n) is a three-dimensional Markov process. The state 
space of the corresponding Markov-chain S can naturally be indexed 
by a triple of nonnegative integers. Let 

P ?0,il,i2 = Pr ^On = lo, y\n = H, yin = l<i\ (20) 

Then 

PIoAai = H Pr {yo,n+i = io. yi.n+i = ii» y2,n+l = ii\ 
iojija 

yOn = JO, yin = h, yin = J2\ P?o.h,J2 ( 21 > 

These form the equations for transition probabilities. Notice that not 
all states (1*0^1^2) communicate with (0, 0, 0). For example, we can show 
that when i = 0, the only states that communicate with (0, 0, 0) are (0, 
0, 0) and (0, 1, 1). Suppose y ,n+i = 0,yi,„+i = *'i andy 2 ,n+i = k- Then 
6„+i = 0. Hence, from eq. (17), b n < l,x n = 0. Butx), = implies y 2 ,n+i 
= yi,n+i- Also, b n < 1 implies xj,_] < 1. Further, y ,n+i = and x\- X < 
1 imply y\,n+\ — 1- However, it can be shown that states that do not 
communicate with (0, 0, 0) are transient (see Sec. IV). So we will restrict 
the state space by allowing it to consist only of those states, denoted by 
A, that communicate with zero. We will continue to denote by S the 
Markov chain on the restricted state space A. Then S is irreducible and 
aperiodic (see Sec. IV). Notice that for every state at time n 

y n < yin < y2n (22) 
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Later in this paper we will show that S is positive recurrent when Ez n 
< 1. For now we will assume this is so. Interpreting the sums over y'o, j\, 
j 2 to extend only over A we have from eqs. (19) and (21), and the defi- 
nitions Of Von, Vin, V 2n , 

P?o7i,i2 = T! Pr \von -io- j\, "In = *2 - h) Pfaiji 

i\-iQ=J2-h 

+ £' Pr \v 0n = 1 + i - ;*i, v 2n = 1 + 1*2 - h\ Pfajiji (23) 

jo>OJi-io=J2-h 

The equilibrium distribution of S: 

lim P? = P 

111X1 * I0,U,I2 * '0,11.12 
n]<*> 

has the property that if PP 011I2 = Pi ,i h i 2 for (i , ii, 12) « ^, so does PJjJife. 
So P t0 ,u,«2 satisfies: 

Pio,h,i2 = £' ^ r i U 0n = io — /b l>2n = *2 " J2} P0J1J2 

ji-io=J2~ii 

+ Y,' Pr {"On = 1 + io - jl, V 2n 

JO>OJl-io=J2-il 

= l + i2-J2\Pj J l j2 (24) 

Z- **0i»li l '2 = ■'■ 

(io,il.t'2)<^ 

Pi ji,i 2 is the unique nonnegative solution of eq. (24) (see Ref. 3). In 
principle, solving the infinite system of linear eq. (24) determines Pi ,i lt i 2 , 
hence the equilibrium distribution of (yo n , yin, yin)- However we will 
see a much simpler way to find equilibrium distributions of the com- 
ponents y 0n , yi n , y 2n , without computing P; 0> ; llI2 . Denote £«**» by </> m (s) 
and Es u ' n by 0;„(s). Then from eq. (19) we can derive the following 
equations paralleling eq. (11): 

0n+l,o(s) = [S _1 0nl(s) + (1 - S -1 )Ci„(s)]0Oi;(*) 
tf»n+l,l(s) = [S _1 0„ 2 (s) + (1 -S" 1 )c 2 n(s)]0l u (s) 
011+1,2(8) = [S _1 0n2(s) + (1 " S- 1 )c 2 „(s)]0 2( ;(s) (25) 

Here 

cin(s) = ZPr \y 0n = 0, y in = ;V, i = 1,2 (26) 

;>0 

For any n the only admissable states in A that have y Qn = are (0, 0, 0) 
and (0, 1, 1). So c,-„(s), i = 1,2 are polynomials of degree 1, and Ci„(s) = 
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c 2n (s). Let <t>i(s) denote the generating function of 



and 



yi = \\myi 



d(s) = lim c in (s) 



for i - 1,2. Then 

0o(«) = [s _1 0i(s) + (1 - s- l ) Cl (s)]<t> v(s) 
<t>i(s) = [s" 1 2 (s) + (1 - s- 1 )^)]^^) 
2 (s) = [s-^zU) + (1 - s-^c^sflfaM (27) 

From eq. (27) 

<t>2(s)= : ITT . \ (28) 

Since 4>q v , <t>i v , 4> 2v are known directly from the distribution of x\, x\, 
eq. (27) gives 0o>$i m terms of Ci(s), the only unknown. Let c\(s) = ko 
+ kis. Then 

Cl (l) = Pr [y = 0, yi = 0} + Pr \y = 0, yi = 1} 

= Pr\y o = 0} = k o + k l 

As in eq. (13) 

ko + k^l-Eixl + xl-z + xl) 

= l-Ez n (29) 

In order to derive another equation for k ,ki we go back to the original 
equations for P loiU 2> e Q- < 24 )- From ec l- < 24 ) we can derive tne following: 
for io = ii = i2 = 0, since u in are nonnegative, Pooo = Pr \v 0n = 0, u 2n = 
0} Pooo + Pr \v 0n = 0, v 2n = 0j Pin. However, v 2n = 2x l n + x\ = implies 
x\ = xl = 0, so u 0n = 0. Therefore 

fco = Pooo = Pr Won = 0} (Pooo + Pin) (30) 

Similarly 

*i = Poii = PrKn = 0}Pn 2 

Pll2 = Pr\v n= l,y2n=2jP m 

+ Pr \u 0n = 1, v 2n = 2} Pooo 
Hence 

ki = Pr \u 0n = 0} Pr \u 0n = 1, v 2n = 2} (Pooo + Pin) (31) 
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Notice that the various probabilities occurring on the right-hand sides 
of eqs. (30), (31) can be calculated from the distribution of {x\,x 2 n ). For 
example: 

Pr |i>o« = 1, o 2n = 2\ = Pr \x\ - 1, ** - 0} 

Therefore using eq. (29) we can determine kQ,k\, hence C\{s). From eq. 
(27), therefore, it is easy to derive the formula for <t>o>{s), namely 



l <j>2v(s) 



<t>o(s) = (1 - s x )ci(s) — 

L 1 - s 1 <f>- 

+ a~ 1 01„(s)0Oy(s) + (f>0u(s) 

= (i -s- 1 )c 1 ( S )0 Ou ( S ) [i+ ClhM 1 (32) 

L 1 "8 ^2u(8)J 

To solve for the equilibrium distribution of 6„, i.e., distribution of yo. 
we do not have to invert <t>o(s). It turns out that eq. (27) can be translated 
to linear recursions for marginal distributions for yo, yi, y 2 - Hence, as 
in Sec. II, the distributions of y q, y i, y 2 are finitely solvable. That this 
is so, in the general case, is shown in Sec. VII. 

IV. QUEUEING PROCESSES WITH MOVING AVERAGE INPUTS 

The most general input process that we will consider in this paper is 
a finite sum of moving averages, i.e., 

*» = i;x>j*Uj (33) 

1-1 7=0 

Equation (1) in this setting is 

b n+1 = (b n -l) + + £ Z ajxU/ (34) 

;=i;=o 

The integer k is referred to as memory of the input process z n . Under 
the assumptions below, the (k£ + 1) dimensional vector process (b n , x\-i, 
xl-2, ... , x\- k , xJUi, .... *l-k, ■■■, xZ-i, ■ ■■ , x f n - k ) is Markov as in the 
example of Sec. III. 

However, by a transformation we will find a (k + 1) dimensional 
Markov process that suffices to describe the queueing system. Define: 

yon = b n 
and, for r — 0, 1, . . . , k — 1, 

e k 

y r +i,n - y™ + L E <XjX l n - j+r (35) 

i=l;'=r+l 
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Let 



r . t 

Y. «; = Mr and £ n' r x l n = v, 

;'=0 i=l 



for r = 0, 1, . . . , k. Then using eq. (34) we can verify: 

y r ,n+l = [(yOn - D + - yon] + yr+l.n + V m , T - 0, 1, . . . , k - 1 (36) 
VM+1 = [(yOn - 1) + ~ yOn] + y/en + Ufe„ (37) 

We make the following assumptions for the rest of this paper: The a) 
are assumed to be nonnegative integers and, for each i, a l > 0. We will 
assume that the vector, nonnegative integer valued random variables 
(x\, x 2 n , . . . , x l n ) are independent and identically distributed, though for 
each n, x\, x\, . . . , x e n will be allowed to be dependent on each other. We 
will also assume that Pr |v„ = 0} > and Pr \u rn > 1} > for some r. 

From the assumptions about x l n , (y<)n» v\n> ■ • ■ , Vkn) 1 - v n is inde- 
pendent of y ; ■ (y j, yij, . .. , ykjY for; < n. Hence y n is a (k + 1) di- 
mensional Markov process. The state space corresponding to this 
Markov process is indexed naturally by a (k + 1) triple of nonnegative 
integers. Furthermore by definition of y,-„, i = 0,1, ... ,k,n = 0,1,2, ... , 
yon ^ y\n ^ yin ^ • • • - ykn- Hence we can assume that if (io, i\, ■ ■ • ,ik) 
denotes a state then 

i <i 1 <i 2 <...<i k (38) 

Let A' denote the set of vectors satisfying (38) and S' the Markov chain 
with state space A'. Of the states in A' let A denote the set of states that 
communicate with the state = (0, 0, . . . , 0)'. Using the following the- 
orem, we will be able to restrict our attention to only those states that 
are in A, and to the irreducible Markov chain S, with state space A, 
derived from S'. 

Theorem 2: 

(i) Every state in A' of the form (m, m, . . . , m)* belongs to A. 

(ii) Every state of S" transitions to a state belonging to A in at most 
k steps. 

(Hi) Every state in A is accessible from a state of the form (m, m, . . . , 
mY in at most k steps. 

(iu) S is irreducible and aperiodic. 

(v ) For each i , the number of states in A which are of the form (i , 
i\, ■ ■ ■ , ikY is finite. 

Proof: Let F denote the (k + 1) X (k + 1) matrix with elements Fy+i = 
1, for i - 0, . . . , k - 1, Fkk m 1» and Fy = otherwise. Also, let 1 denote 
the vector (1, 1, . . . , 1) '. We note that Fl = 1 and, for any y = (y , y i, . . . , 
ykY, F r y = (y n ■ ■ ■ , yk, yk, ■ ■ ■ , ykY by induction. Equations (36) and 
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(37) can then be written in vector form as follows, using o n to denote yo n 
- iyon - 1) + - Note that a n = 1 if y 0n > 0, and a n = if y 0n = 0. 

yn+i = Fy n - <r n l + v n ,n = 0,1,2, ... 

We can then show that for n — 1 > i > 

y* = F"-'y t - - "e 07 1 + "E F»- W V; - (39) 

Hence, if v/ = Ofor j = rt — 1, . . . , n — k, then it follows from (39), with 
i = n — k, that y n is a vector of the form m 1 = (m, m, . . . , m)' for some 
nonnegative integer m. Therefore, since Pr\vj = 0} > by assumption, 
is accessible from any state by allowing v ; - to be zero for as many con- 
secutive ;'s as needed. We assumed earlier that Pr \u rn > 1} > for some 
r. Hence, since Vk n ^ u rn , Pr \vkj = M \ > for some integer M > 1 and 
all ;. Therefore, if y = 0, v k j = M for ;' = 0, 1, . . . , n - 1 implies y kn > 
nM — n. Hence Pr \yk n > nM — n, y = 0} > 0. For every sequence v ; 
such that v ; - = for j = n, n + I, . . . , n + k, . . . , y n +k+i remains pro- 
portional to 1 for all i > 0. Therefore, for each m, Pr \y n +k+i = m 1, yo 
= Oj is greater than zero for some n,i dependent on m. From (39) we can 
therefore show that any state of the form m 1 communicates with and 
hence belongs to A . 

If yo « cA', then we will prove, irrespective of what v/s are for j = 0, 
1, . . . , k — 1, that yk e A, by showing that y^ is accessible from a state 
of the form m 1 in at most k steps, where 

k 
m = k+y k0 - E ok-j (40) 

y'=i 

Let y'j, j = 0, 1, . . . , k be the sequence of states traced by S' if y is set 
to zero but \j,j = 0,l...,k — l are left unchanged. If a) = y ; — (y' j — 
1) + fory = 0, 1, 2 . . . then (39) holds with primes on y/s and cry's, and 
y = 0. We will first prove that for each k, y* > y'k by showing that for 
each i: 

yi - y'i > 0, F( yi - y'i) - (y,- - yj) > 

=> Yi+i ~ y'i+i ^ 0, F(y J+1 - y ; +1 ) - (y I+1 - yj +1 ) > (41) 

Suppose the assumptions in (41) hold as they do for i = 0. Then y k i - 
y'ki ^ yk-u -y'k-u ^ • • • ^ yo. - y'oi ^ 0. Therefore if y oi > y' oi , then 
(y« - y/) + (ff'i - ai) 1 > 0, which is trivially so if y oi = y' oi . Hence, using 
(39) and corresponding equations for y| +1 , 

y»+l ~ yi+i = F(yi - y' t ) + {a\ - er f )l > (y 4 - - y'i) + (a- - <r,-)l > 

Furthermore 

F(y i+ i - y' i+1 ) - (y i+l - y' i+l ) = F[F( yi - y' t ) - (y t - - y' ( )] > 
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since all elements of F are nonnegative. Hence in particular, 

k , k 

ykk - ykk = yko+ E <^k-j - L **-,• ^ o 

Therefore from (40), with 

k 
s = £ ff^_ ; -, s + m>k. 
j=i 

Now let y \ be the sequence of states traced by S' if yo were set to m 1 
while Vj,j = 0,l,...,k — l were left unchanged. Then, with a\ = y" oi — 

iyii - D + , 



yl - y'i - (to + L ffi_y - L *■_;) l 

V /=1 7=1 / 



(42) 



for each i. As before, using (41) we can show y\ — y • > 0. From (42) we 
have y' i+l -/i+i = y'i ~ y'i + (oi - ff'i)h hence y," = yj -» <r," = ai =» yj+i 
= y - +1 . If o-,- = for some i < k, then y^ = 0, but yoi ^ yo„ hence yo/ = 
yo, and y] = y\ from (42). So o\ = => y" n = y' n for fe > n > i. So in par- 
ticular 

y'k-y'k= (m+Z a'k-j - £ o" k _j) 1 = (43) 

However, we noted earlier that 

k 
s + m = m + £ (T fe _ ; > k 
/-l 

Hence (43) can only hold if 

fe 

S + m = k = £ fffc_y 

Therefore we have shown that for each i < k, o\ = 1. Now we use eqs. (40) 
and (41) to show 

k k 

yk-yk=(m- y k0 )l - £ ff ' k _jl + Y. ffk-jl - (44) 

Since y^ belongs to A , being accessible from m 1 belonging to .y? , we 
have shown that, starting from any state in A', S' transitions into a state 
in A in at most k steps. Furthermore, every state of A is accessible from 
some state of the form m 1 in at most k steps. It is clear from the defini- 
tion of A that S is irreducible. To show that S is aperiodic, we merely 
note that y ; can equal zero for arbitrarily many consecutive j's with 
positive probability. 

We will now prove that the set of states in A which are of the form (0, 
ii» • • • » ikY is finite. This result is used later to derive conditions for the 
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positive recurrence of S. We just showed that every state in A is acces- 
sible from a state of the form m 1 in k steps. In particular, if a state of the 
form (0, i\, . . . , ikY is y*. with y = ml for some m then 

k k 

yok = m - E a k -j + E Vu-jj-i = 

7=1 y=i 

k k 

ykk = m- E fffc-y + E »*J-i (45) 

;=i >=i 



Hence 



and 



Therefore 






k e k 

E »*-a/-i = E E j»i-y*}-i - fe 

7=1 i-1 ;-! 



E (£*}-!) <fe 

j=l V/-1 / 

since, for i = 1, 2, . . . , £, <x 1 q = n l > 1 and /tj ^ Mo for ; = 0, 1, . . . , ft. 
Therefore, from eq. (45), 

k 

ykk ^ E Vkj-i 
;'-i 

* . ft 

S E m5, E *J-i 

i=l 7=1 



-(?/*) 



(46) 



Hence for every state 



{0,i u ...,i k YiA,i k <k EmL 

i=i 

hence such states are finite in number from eq. (38). In a similar way we 
can show for any integer / the states (i'o, i\, . • • , ikY « A such that io - 
j is a finite set. 

The transition probabilities for S can be derived from eqs. (36) and 
(37). Let Pjf = Pr \y 0n = k, ym = h, ■ . . , y*„ = iki Then 

p ? +i= EPr{y n+1 =i|y n = j}P? (47) 
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P" +1 - L Pr {"On = io-jh---, U*-l,n = »fc-l ~ jk, Vkn 

y'o=0 

■ Ift - 7*1 P" +1^ I^On = i - ;'l + 1, • • • , Ufc-l.n 
>o>0 

= ik-l ~ jk + 1, "*n = i* ~ /A +UPj (48) 
If the equilibrium probabilities 

Pi = lim P? 

At- 

exist, then P" = P s for every i e j4 implies P? +1 = P|, i e A. Furthermore 
Pi is the unique nonnegative solution of 

LPi = l 

UA 

*i = E Pio-J\,il-J2 ik-jk™\ 

jo=0,j(A 

+ £ Pio-;'i+i,ii-72+i,...,i'*-;'*+i^J (49) 

;'o>0,jtj4 

Here p l0il -, ,- A = Pr \v 0n = i , . . . , v kn = iki 

We show next that S is positive recurrent when Ez n < 1. 

Theorem 3: S is positive recurrent if 
Proof: Define a new process c n as follows: 

Cn+!=(C„-1) + + E/li*i 
i=l 

■(cn-D+H-Ofa, (50) 

We know that the Markov chain corresponding to c n is positive recurrent 
if Evkn < 1 from Theorem 1. In particular if Evkn < 1 then 

limPr{c n = 0}>0 
B t« 

The processes c n , b n as defined by eqs. (50), (34) are related by x l n , i - 
1, . . . , t. Let 6o = and let r be such that b n -i > for i = 0, 1, . . . , r — 
1 and b n - r = 0. Then eq. (34) implies that 

r t k . . 

bn+i = EEL a l jx' n -j- m -r (51) 

m = i-lj'-O 
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We also know from eq. (2), assuming Co = 0, that 

r+k e 
m=0i=l 

From the definition of /4 it can be easily verified that 

C n +1 ^ bn+1 - k 

Hence 

Pr\b n+1 <k\>Pr{c n+l = 0} 
When Eukn < 1 we know from Theorem 1 that 



hence 



limPr{c„ +1 = 0j>0 



liminfPrjfe^+i < k\ > 



Let the set of states (io, *i, . . . , ifc) in ^4 with t'o < k be denoted by ^1^. 
Let Py be the probability of S being in state i at time n starting from j 
at time 0. Then, we have shown that 

lim inf £ Pf > 

Since cardinality of Ak is finite 

liminfP? >0 

for some i « Ak- We also know that is accessible from i. So Pfo > for 
some r. Therefore 

lim inf Pgo +r > lim inf P r oi P? > 

Hence is positive recurrent. Therefore, since S is irreducible and 
aperiodic, S is positive recurrent. 

V. GENERATING FUNCTIONS FOR JOINT DISTRIBUTIONS 

We will now derive expressions for joint distributions of (y>o, y\, . . . , 
yk) assuming Ez n < 1, so S is positive recurrent. Let 

£(n«H =4>n(S0,Si,...,S k ) 

and 

E ( LI s° r A = o (so, s h . . . , s k ), \si\ < 1 
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From eqs. (36) and (37) we have, using independence of v„ and y„, 
0n+i(so, *i, • • • >Sk) 

X 0t,(s o , si, . . . ,s/j) (52) 
Proceeding as in eq. (11) we can show 

0n+l(«O, »b • • • ,8k) ■ 0n(l, «0, «1, • • ■ . Sk-2, Sfe-iS*) f[ *« _1 
+ (l - ft S« _1 ) *»(°i S 0> Si,..., Sk-lSk) 

X0 u (s o , si, . . . ,s k ) (53) 

When 0„ is the generating function of the equilibrium distribution i.e., 

when 

k 
<t>n(so, Si, ... , s fc ) = 0(s o , si, . . . , 8 k ) = £ II *?' (54) 

i=0 

then n+ i = 0. Therefore satisfies 

0(s o , si, . . . , s k ) = 0(1, s , s b . . . , s k -2, Sk-iSk) ft s . _1 
L i=o 

+ (l - II S . _1 ) 0(0. «0» Si, . . • , S k -2, Sk-lSk) 

X 0u(s o ,si, ... ,s fe ) (55) 

We note that 0(0, fci, . . . , t k ) is a polynomial of finite degree since the 
set of states (0, i\, . . . , ik) is finite. Knowledge of 0(0, t h . . . , t k ) deter- 
mines 0(s o , Si, ... ,8k) as follows. If we sets = si = • • • = s^-i = 1 then 
(55) becomes 

0(l,l,...,l,s*) = [Sk l <J>{l,l,...,l,S k ) 

+ (1 - Sk ^0(0, 1, 1, . . . , 1, s*)]<Ml, 1 1, Sfc) 

This determines 0(1, 1, . . . , l,s/e) in terms of 0(0, 1,1,... ,Mft): 

0(l,l,...,l,s*) 

_ (1 - Sfe 1 )0(Q,1,1, . . . , 1, s/,)<Ml, 1, ■ ■■, 1, Sk) (56) 

1 -Sa^bU, 1,. -.,l,Sfc) 

For r - 0, 1 k set 

r (s r , . . . , 8k) - 0(1,1, . . . , 1, S r , S r+ i, ...,8k) (57) 
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Then eq. (56) determines 0* in terms of 0(0, 1, . . . , 1, Sk). Using eq. (55) 
yields: 

[k 
USi 1 (f> r+1 {s r ,...,S k -2,S k - l S k ) 
i-r 

+ (i - n *, rl ) 0(0, i, . . . , s r> . . . , Sk - lSk )] 

X<t>o(l,h...,l,s r ,...,s k ) (58) 

So starting with 4> k , k applications of (58) yields 0°(s o , . . . , Sk) = 
<f>(so, . . . , Sk) in terms of 0(0, S\, . . . , Sk). Equations (15) have a coun- 
terpart here. These can be derived in mechanical fashion using formal 
power series expressions for and 0„. we will not go into the details here. 
The derivation is analogous to that given in Sec. VII for the margin- 
als. 

In the case £ = 1, an alternate generating function was considered in 
Ref. 8. The corresponding generating function is obtained by setting 

k 
uj =Usi,j = 0,...,k 

and defining 

0(S O , 8 1, . . . , S k ) = ${u , Ui,..., U k ) 

= lim E (ul Qn J] u y r rn - yr - l A 

,1— oo \ r =l / 

Then corresponding to eq. (55), 

<*>(u , u h ... , u k ) = [uq 1 $(u , u , i*i, ... , u k -i) 

+ (1 - [V)<I>(0, Uq, Ui,... , U*-i)]$ u (l*o, "1, • • • , Uk) (550 

where 

* {u ,u 1 ,...,Uk) = E/ll u? r A 

with 

e . . 

W rn = E <X l n 
i=l 

It follows from eq. (55) that, for j = 0, 1 k-2,{k> 2), 

$(S, ... ,S,U h . . . , U k -j) = [S -1 $(S, . . . , S, Ui, . . . , Uk-j-l) 

+ (l-s-i)<i>(0,s,...,s,u 1 ,...,Uk-j-i)] 

X $„(*,..., s, i*b ..., ttft-j) (580 
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and 

<t>(s, . . . , s, Ui) 

= [s-^is, ..., s) + (1 - ff-WO, s, . . . , s)]$ v (s, ..., s, m) (58") 

These equations are equivalent to eq. (58). If we set u\ = s in (58") then 
we may solve for $(s, . . . , s) = 0(1, . . . , 1, s), as in (56). 

VI. FINDING <}>(0, s-,, ... ,s k ) 

We will show here that a finite system of linear equations can be ob- 
tained to solve for the coefficients of the polynomial of finite degree that 
represents 0(0, Si, . . . , «*). Let 

k 

tjisi,. . . ,s k ) = ft n sf 

i=l 

where fi = Pr\yo = 0} and let 0j(so, Si, ... ,8k) he related to \pj as </>(so, 
Si, . . . , 8k) is to 0(0, Si, . . . , Sk) in eq. (58). That is, if 6] is defined as in 
(57), 6] (s r , . . . , Sk) = 6j (1, 1, . . . , 1, s r , s r+ i, . . . , Sk), then 6] satisfies 
the set of equations equivalent to (58): for r = 0, 1, . . . , k — 1 

6] (S r , , S k ) = ft S' 1 0j +1 (S r , . . . , S k -2, Sk-lSk) 

Li=r 

+ f 1 - fi S." 1 ) ^j(l, 1, • • • , 1, S r , . . . , S k -2, Sk-lSk) 

X0„(l,l,...,l,a r ,...,s fc ) (59) 
and (56) corresponds to 

B) (s k ) = (1-«*'WU ; -.U^(U 1,«>) (60) 

1 -s k l (t> v (l,l,...,l,S k ) 

From the definition of (f> v , fail, 1, . . . , 1, Sk) = Esk kn [see above (52)]. 
Hence from (50) and applying (13), (14) we have 

d k i (sk) = -t i (l,l,...,Sk)<t>c(s k ) (61) 

M 
where c = lim n f«, c n and £s£ = <t> c (sk)- Hence whenever \x > 0, 

1 ,x 

-0c(') 
M 

is a generating function. Now, it can be easily verified that corresponding 
to each j the unique solution 0^(s o , . . . ,s k ) = Oj(so, s h . . . ,Sk) satisfies 
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an equation similar to (55): 

[k 
0j(l, S , Si, . . . , S k -2, Sk-\Sk) II s i 
(-0 

+ (l ~ fl S~ l J\pj(s ,S h ... , S k -2, Sk-lSk) 

X0u(so,s b . . .,s k ) (62) 

The family of such solutions 0j are linearly independent. If the generating 
function of Pi (the equilibrium distribution of S), 0(so, S\, . . . , Sk), is 
such that 

0(O,si,...,s a ) = /*L / cj II W' (63) 

where the sum on the right is over all indices j = (0,ji, . . . , jk) which are 
in Jl, then </>(so, 8%, . . . , 8h) has the unique representation 

<t>(s , Si, ... , s k ) = iy Cj0j(s o , s h ..., s k ) (64) 

j 

Notice that corresponding to each j there exists a sequence Pi(j), not 
necessarily nonnegative, such that 

L PitiH si 1 . • • 4* = 0j(so, si, • • • , s k ) (65) 

Hence Pi itself has the representation 

Pi-Z/CjPiO) (66) 

j 

Furthermore 9j(sk) from (61) corresponds to a nonnegative summable 
sequence. From (59), starting with r = k — 1 and going backwards to r 
= 0, we can show that for each j, Pi(j) is the convolution of absolutely 
summable sequences and hence 

L|Pi(J)|<~ (67) 

From eqs. (61), (65), and (66), when 2] Cj = 1, 

E Pi -E'cjtfd) 

UJL j 

= L'cj = 1 (68) 

j 

We will now show that there is a finite number of linear equations 
derived by substitution of (66) into (49) which uniquely determine {cj} 
and hence Pi. Let us denote the elements of the transition probability 
matrix of S, Pr \y n+l = i| y n = j}, by Ty. Then from (40) 
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P\ = £ TijPj (69) 

it A 



Substitution of (66) yields 



£' c m Pi(m) = £ Ty £' c^ro) (70) 

m jt^4 m 

which is a set of linear equations for c m . Hence any solution \d m \ of (70) 
has the property that Q\ = 2' m d m Pi(m) satisfies (69), hence 

Qi = £ TyQj (71) 

)tA 

Now let T-j be the rc-step transition matrix of S. Then using (71) we 
have 

Qi = £ rg Qj (72) 

jt-A 

Since S is positive recurrent 

lim rg = Pi (73) 

Furthermore since 2i|Pi(/)| < ro for each j, 2i|Qi| < ». Hence taking 
limits of both sides of (72) and interchanging limit and sum on the right 
hand side of (72) we have 

Qi = lim £ Tg Qi 

= Pi£Qj (74) 

j 

However, if 2 i d j = l then, from (68), Zi Q { = 1. Therefore 

Qi = Pi (75) 

Since Pi(j) are linearly independent, Cj = d$ for each j, and |cj} are the 
unique solution of (70). 

Remark 1 : A similar set of equations can be obtained by substituting 
(64) into (55) and equating the coefficients of like powers on both sides 
of (55). 

Remark 2: Note that 0(0, Si, . . . , Sk) - fi in the case when, for each i, 
j, a) > 0. Hence (58) may be used repeatedly to obtain an expression for 
0(s o , «i, • • ■ , s k ). Herbert 6 considered this model when t = 1. 

In the alternate formulation $(0, Ui, . . . , Uk) is a multinomial. 
Moreover, from (34) and (35), since a& > 0, i ■ 1, . . . , £,yo n m -* x'„-i 
■ 0,1 - 1, . . . , /, which implies y kn = Vfe-i.n- Hence $(0, u h . . . , u k ) is 
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independent of Uk- From (58') and (58"), $(s, U\, . . . , Uk) may be ex- 
pressed in terms of $(0, s, . . . , s, u\, . . . , Uk-j-i), j = 0, . . . , k — 2, and 
$(0, s, .... s). If we let s -*■ in this expression, and equate $(0, U\, . . . , 
Uk) with the finite part, we obtain a system of homogeneous linear 
equations for the coefficients in the multinomial. In general, we also 
obtain a (consistent) set of homogeneous linear equations from finiteness 
conditions. 

VII. GENERATING FUNCTIONS FOR MARGINALS AND FINITE 
SOLVABILITY 

The joint distributions of (yo, y\, ■ ■ ■ ,yk) have (k + 1) arguments. We 
will see that we can reduce the problem to "k + 1 one-dimensional 
problems" when we are only interested in the marginal distributions of 
.Vo> y\, ■ ■ ■ , yk- Let us denote the generating functions of y, by 4> t (s) and 
those of v rn by r y(s)- Then 

i 
&(s) = 0(l,l,...,s,l,...,l) 

i + 1 k-i 
- $ («, . . . , s, 1 1), i « 0, . . . , k (76) 

From (55) we then obtain for r — 0, . . . , k — 1 

r r + l "I 

r (s) = I S-tyr+lGO + (1 - s -1 )0 (0, 1, ... , s ,..., 1) Urois) 

and 

<f> k (s) = [s-^M + (1 - s- l )4>(0, 1, . . . , 1, s)]<j> ku (s) (77) 
Note that 

0(0,1 *,..., 1) 

r k-r 

= $(0,s,...,s, l,...,l),r = l,...,fc 

Therefore once the c } have been determined from the method pre- 
sented above, Eq. (77) gives the marginal distributions. Once again we 
can translate (77) into linear equations for the distributions themselves 
as in (15). The marginals are finitely solvable in the sense that a finite 
number of components of the marginal distributions can be solved for 
from a finite number of linear equations. 

For each r = 1, 2, . . . , k let y r j be the coefficient of sJ in the polyno- 
mial 

0(O,l,...,s,...,l) 
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denoted by c r {s). Equating coefficients of like powers of &[ on both sides 
of (63) after setting s,- = 1 for i ?± r yields 

yrj = nL'Cj (78) 

Therefore since the Cj's can be determined as the solutions to a finite 
system of linear equations, so can the 7 r /s. 
Let 

<l>r(s)= E V r j8J, U rj = i, *rj 
j=0 i=0 

and F r (s) = S" =0 U r jS j for \s\ < 1 and r - 0, 1, . . . , k. Then F r (s) = 
<t> r (s)/(l - s), and eqs. (77) become 

F r (s) = s-^Fr+^s) - c r+1 (s)]<f> rv (s), r = 0, 1 k - 1 (79) 

Fk{s) = ^(s)c k (s) m 

From (79) we can show that, for each r = 0, 1, . . . , k - 1, {Urj}ffi are 
determined from |n r+ ij}jSj r+1 by a finite set of linear equations, for any 
N. Let the sequence \8 r j\ correspond to s _1 [F r+ i(s) — c r+ i(s)]. From the 
definition of F r +i(s) and c r+ i(s) it follows that n r+ i i0 = 7r+i,o> Therefore 
8 r j — for j < and 

b r j = n r+1 j+i - jr+ij+i for 1 < ;' + 1 < degree of c r+ i(s) 

= II r +ij + i for; + 1 > degree of c r+ i(s) (81) 

From (79), the sequence {II r; |jS, r is the convolution of {6 r j\ with \p r j\— the 
sequence of probabilities corresponding to the characteristic function 
ru (s). Therefore, since the sequence {p r; } is known a priori, we can find 
Il r y as: 

n r y = E Kj-iPn, ; = 0, 1, . . . , AT + r (82) 

i = 

Hence, we observe that {n y}j^=o can be determined as solutions to a finite 
system of linear equations using \l\-kj\f*Q- 

In order to find \U.kj\f=o k we proceed as in (15). Equating the coeffi- 
cients of like powers of sJ in 

<Pkv(s] 
/to"*'" (kkM-S 






yields: 



n fe0 =i 
n'kj = (pkj + n'kj-i - i. Pkirtkj-?) / Pk0 

7 = 1,2, ,N + k (84) 
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Therefore {nj^j^o* can be determined uniquely as solutions of (84). From 
(80) and (83), {Hy}j!ft* is the convolution of {Jl' kj \ with \y kj \, 

Tl kj = i n' k>M y ki , j = 0, 1 . . . . N + k (85) 

t'=0 

Therefore we have shown that each of the H r j, and hence the marginal 
distributions ir r j, r = 0, 1, . . ., k, j = 0, 1, . . ., N + r, can be found, for any 
finite N, as solutions to a finite system of linear equations. 

VIII. A LIMITING CASE 

For each m let dj m be a nondecreasing sequence of nonnegative inte- 
gers such that 

(i) dj = 0, dji = j ; j = 0, 1, . . . , k 

{ii) lim d jm - dj-i im = <», ; - 1, . . . , k (86) 

We define a sequence of processes \z%\ which will be time-scaled versions 
of z n . Let 

i=l ;=0 

We observe that 2 J, is the same as z n , and z% is the "fastest" version of 
z n , in the sense that all the packets triggered by x l n are bunched together 
and arrive at the same time. As m increases the different delayed con- 
tributions of x l n are spread farther and farther apart in time. The limiting 
case can then be interpreted as the "slowest"; see Ref. 7. 

Let {tj n \, n = 0, 1, 2, . . . , be a sequence of independent identically 
distributed random variables such that for each n the distribution of rj n 
is the same as that of z n . We will show that t/„ then corresponds to the 
slowest case: the finite dimensional distributions of the processes {z™}, 
m = 0, 1, . . . converge to the corresponding distributions of \t] n } as m f 
00 . Indeed, let n\ < j%2 < ••• < n s be nonnegative integers. Then 

Pr \zZ = h, z% 2 = i 2 ,..., zZ = i s \ =UPr \z% = ij\ (87) 

for large enough m, in particular for every m such that dj m — dj-i itn > 
n s — ni,j = 1, . . . ,k. However from the definition of rj n , Pr {zJJJ —ij\ — 
Pr \vnj = ij\- Therefore from the independence of i) n and (87) 

Pr[zy i = ix,z™ 2 = i 2 ,...,zZ = i s ) 

= P \Vni = H, Vn 2 = l2,---> Vn a = h] (88) 

for large enough m. 
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We now define a sequence of processes 6™, 6„ corresponding to z„, 
ri n respectively. Formally let 

&j&i-(&r-D + +*r 

b- +1 = (b;-\) + -^ Vn (89) 

Since Ez™ = Eri n , if Ez„ < 1 then for each m, lim nt cc 6™ = 6 m is a well- 
defined random variable, and so is 6" = lim n | m b„. We can then show 
that 

limb" = 6" (90) 

m\-> 

from Theorem 22 in Ref. 9, since z™ 77,, are nonnegative. Hence the 
distribution of fc°° approximates the distribution of b m for sufficiently 
large m. Therefore for each j 

\imPr{b'»<j\ = Pr\b~ <j\ (91) 

mt- 

Therefore 6°° is the steady-state queue size corresponding to the 
"slowest" version of z n . Let 



0*(«b. ■.,«*) =£(.n*f») 



Then it is easy to verify that Es z ° and Es" n are given by 

k 
(t>x= <Ms" J , srt, • • • . «"*) and 4>; = II <£* (« af » s " ? > •••>«"') 

i=0 

respectively. If 0° = Es b ° and 0" = Es b ~ then 



(l-s-^S(s)M 

l-s-y^s) 

(l-S-^^s)/! 



(92) 

i-s- 1 (/>;(s) 

In the special case when l — \ t and (omitting the superscript) a, = 
or 1 for each ;', we have an interesting special relationship between <£° 
and 0" . Let f° n = Pr \b° < n\, /" = Pr \b~ < n\ and F° = 2/°s«, F" = 
2/> n . Then F° and F°° are 0°/l -s and 0*71 - s respectively for \s\ < 
1. We will show that 

equivalently 

Pr|6~ <n} = Pr{60< nMfe } (94) 

QUEUES WITH CORRELATED INPUTS 1767 



Let to be a primitive /ifcth root of unity. Then for \s \ < 1 

Mfc j'=0 MA i=0 0x(s"*) - ^'S 

_ M^(«»)]« =F „ (sM) (g6) 



[0x («"*)]"* -«"* 



Therefore 



n=0 MA i'=0 m=0 

n=0 

Since /° and /" are both increasing and bounded by 1, (96) shows that 
(93) holds. 
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